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Abstract 

The evolution of the Internet has manifested itself in many ways: the traffic characteristics, the interconnection 
topologies and the business relationships among the autonomous components. It is important to understand why 
(and how) this evolution came about, and how the interplay of these dynamics may affect future evolution and 
services. We propose a network aware, macroscopic model that captures the characteristics and interactions of the 
application and network providers, and show how it leads to a market equilibrium of the ecosystem. By analyzing 
the driving forces and the dynamics of the market equilibrium, we obtain some fundamental understandings of the 
cause and effect of the Internet evolution, which explain why some historical and recent evolutions have happened. 
Furthermore, by projecting the likely future evolutions, our model can help application and network providers to 
make informed business decisions so as to succeed in this competitive ecosystem. 

I. Introduction 

The Internet has been and is still changing unexpectedly in many aspects. Started with elastic traffic 
and applications, e.g., emails and webpage downloading, we have seen significant rise in inelastic traffic, 
e.g., video and interactive web traffic, across the Internet. According to lfi~9l . from 2007 to 2009, web 
content traffic had increased from 41.68% to 52%, reaching more than half of the total Internet traffic. 
From a network perspective, the Internet originated from government-owned backbone networks, i.e., 
the ARPANET, and then evolved to a network of commercial Autonomous Systems (ASes) and Internet 
Service Providers (ISPs). Meanwhile, ISPs formed a hierarchical structure and were classified by tiers, 
with higher tier ISPs cover larger geographic regions and provide transit service for smaller/lower tier 
ISPs. However, recent study [17J has reported that large content providers, e.g., Google and Microsoft, 
are deploying their own wide-area networks so as to bring content closer to users and bypassing Tier-1 
ISPs on many paths. This is known as the flattening phenomenon of the Internet topology. 

Changes in the content or network topology do not happen independently. Rather, they are driven by 
the changes in the business relationships among the players in the Internet ecosystem. Not surprisingly, 
we have observed dramatic changes in the business relationships between the content providers and the 
ISPs and among the ISPs themselves. Traditionally, ISP settlements were often done bilaterally under 
either a (zero-dollar) peering or in the form of a customer-provider relationship. Tier-1 ISPs, e.g., Level 
3 |0, often charge lower tier ISPs for transit services and connect with each other under settlement- 
free peering. However, the Tier-1 ISPs do not have any guarantee in their profitability as the Internet 
evolves. For instance, we have seen exponential decrease (around 20% a year) in IP transit prices ll23l . 
Also, peering disputes happened, e.g., the de-peering between Cogent [3] and Level 3 in 2005, where 
the lower tier ISPs that are closer to content or users refused to pay for the transit charge. This leads to 
the recent debate of network neutrality ||26ll , which reflects the ISPs' willingness to provide value-added 
and differentiated services and potentially charge content providers based on different levels of service 
quality. 

The situation is further complicated by the emergence of new players in the ecosystem: Content Delivery 
Networks (CDNs), e.g., Akamai [I] and Limelight [6], and high-quality video streaming providers, e.g., 



Netflix 0. From content providers' perspective, CDNs can deliver their content faster and more efficiently; 
from local ISPs' perspective, CDNs can reduce the traffic volume from upstream, saving transit costs from 
their providers. Very often, ISPs do not charge the CDNs for putting servers in their networks. When 
the video streaming giant Netflix moved online a few years ago, its traffic surged immediately. Now it 
accounts for up to 32.7% of peak U.S. downstream traffic [8| and its traffic volume is higher than that 
of BitTorrent [9| applications. Netflix used Limelight, one of the biggest CDNs, for content delivery, and 
later, the Tier-1 Level 3 also obtained a contract to deliver Netflix's traffic. Since most of the Netflix 
customers are based in the U.S., they often use Comcast, the biggest access ISP, as the last-mile access 
provider. Interestingly, Comcast managed to enter a so-called paid-peering relationship [161 with Level 3 
and Limelight, under which the Tier-1 ISP and the CDN have to pay the access ISP for higher bandwidth 
on the last mile connection. This has totally reversed the nominal customer-provider relationship where 
the Tier-1 ISP was the service provider and should have received payment for connectivity. 

It is important to understand how these changes come about, and what the driving factors are behind 
these changes. In this work, we model the Internet evolution from a macroscopic view that captures 
the cause and effect of the evolution of the individual players in the ecosystem. Our model expends 
the traditional view of a single best-effort service model to capture multiple value-added services in the 
Internet. The main approaches and contributions are as follows. 

• We model the preferences and business decisions of the application providers for purchasing Internet 
services, based on the application characteristics and the price and quality of the transport services 
(Section |p. 

• We characterize the market price and the market share of the Internet transport services by using 



general equilibrium theory in economics (Section III). 



We analyze the driving forces of the evolution of the Internet economic ecosystem (Section IV), 



which provide qualitative answers (Section IV-F) to questions like: 1 ) Why have the IP transit prices 
been dropping? 2) Why have the CDNs emerged in the ecosystem? 3) Why has the pricing power 
shifted to the access ISPs? 4) Why are the large content providers building their own wide-area 
networks toward users? 

We incorporate Internet price and capacity data into our model, and quantitatively fit historical prices 
and project the future evolution of the ecosystem and its price trends (Section [V]). 
We demonstrate how our model can help the network providers to make business decisions, e.g., 
capacity expansion and peering decisions, based on the future price projections under various scenarios 



(Section V-C). 



Our paper sheds new light on the macroscopic evolution of the Internet economic ecosystem and 
concretely identifies the driving factors of such an evolution. In particular, our model provides a tool 
to analyze and project the evolutionary trends of the ecosystem. The fundamental understanding of the 
preferences of application providers and the market equilibrium of the Internet services will also help 
the business decisions of the application and network transport providers to succeed in this competitive 
ecosystem. 

II. The Macroscopic AP-TP Model 

We start with a macroscopic model of the Internet ecosystem that consists a set of Application Providers 
(APs) and Transport Providers (TPs). The TPs differ by their service qualities and the prices they charge. 
We model and analyze the APs' choice of TP based on their own characteristics: how profitable the AP 
is and how sensitive the AP traffic is to the obtained level of service quality. In essence, this macroscopic 
model can help us to understand the decision process of these players in the Internet ecosystem and how 
these decisions may influence their business relationships. 



A. The Application and Transport Providers 

We consider an Internet service market of a geographic region and denote (Ai,M) as a macroscopic 
model of the ecosystem, consisting of a set M. of TPs and a set M of APs. The APs provide the 
content/service for the Internet end-users; the TPs provide the network infrastructure for delivering the 
APs' data to their end-users. 

Our notion of an AP broadly includes content providers, e.g., Netflix, online services, e-commerce, and 
even cloud services, e.g., Amazon EC2 @. Our notion of a TP is based on the APs' point of view. In 
other words, the transport services provided by the TPs are for the APs to reach their customers/users. 
The scope of a TP is broader than an ISP, and it includes CDNs. ISPs, depending on different taxonomies 
lfT6ll . lfT5l . EH, include 1) eyeball/access ISPs that serve the last-mile for end-users, 2) backbone/Tier 
1 ISPs that provide transit services for lower tier ISPs, and 3) content ISPs that serve APs and host 
content servers. A TP can be an ISP of any type. Although access and transit ISPs traditionally do not 
have business relationships with APs explicitly, with the emergence of video streaming APs, e.g., Netflix, 
we have seen more and more APs' direct or indirect contracts with the access and transit ISPs. For 
example, Level 3 contracted with Netflix for content delivery and Comcast managed to charge Level 
3 and Limelight via paid-peering contracts (for delivering Netflix's traffic to Comcast's customer base 
faster) [|23l . Although "whether ISPs should be allowed to differentiate services/charges for APs" is hotly 
debated under the network neutrality 11261 argument, legitimate service differentiations will also induce 
more extensive business relationships among the APs and ISPs. In general, a TP can be any facilitator that 
delivers content to end-users. An important example of a TP that does not even own network infrastructures 
in the current Internet ecosystem is Akamai [T|, which represents the CDNs. 

We characterize each TP / G M. by its type, denoted as a triple (pi,qj,uj). pi denotes the per unit 
traffic charge for the APs to use TP /. qj denotes the service quality of TP J, e.g., queueing delay or 
packet loss probability. Without loss of generality, we assume that qj > and smaller values of qj indicate 
better quality of services, vj denotes the bandwidth capacity of TP /. We characterize each AP % G M 
by its utility function In particular, we define Ui(pj,qj) as AP z's utility when it uses TP /, which 
depends on the service quality qi and the per unit traffic charge pi. 
Assumption 1: ■) is non-increasing in both arguments. 

Assumption 2: For any set Ai of TPs, each AP i G M chooses to use a TP, denoted as L t G M, that 
satisfies 

UiiPh, QiJ > UiiPi, <?/), V J e M. 

The above assumes that each AP is rational and chooses a TP that provides the highest utility. Technically, 
there might exists multiple TPs that provide the same amount of utility for the AP. We assume that every 
AP has certain preference to break the tie and choose one of the TPs. We further denote Mi C M as the 
set of APs that choose to use TP /, or the market share of TP /, defined as Mi = {i <E M : Ii = 1} . 

Based on Assumption [T] and [2j if two TPs /, J have the same quality, i.e., qi = qj, then they have to 
price equally, i.e., pi = py, otherwise, the one with higher price will not obtain any market share. As TPs 
differ only by price pi and quality qi from the APs' perspective, we aggregate the TPs that have the same 
value pair (pj, qj) into a single TP with a capacity that equals the summation of individual TPs' capacity. 
Similarly, if a TP performs service differentiations, we conceptually treat it as multiple TPs, each with a 
service class (pi, qi) and the corresponding capacity vi. More precisely, our abstraction of a TP / models 
a competitive market segment that provides a quality level qi and has a total capacity z//. 

Lemma 1: Under Assumption [T] if Ai and M! are identical except for one TP / with p\ > pj, then 
Mi(M') QMi{M). 

Proof: Let i be an AP i G Mi(M'). By Assumption^ we have u^p'j, q'j) > u^p'j, q'j) for all J G .A/f \{/}. 
Since p\ > pi, we have Ui(pi, qi) = u^pi, q'j) > u^p'^ q'j) > u^p'j, q'j) = Ui(pj, qj) for all J G M\{I}. 



This implies that AP i will choose TP / over all the TPs, and therefore, i E Mi{M). This concludes 
Afi(M') CAfj(M). ■ 
Lemma [T] implies that when a TP increases (decrease) price unilaterally, fewer (more) APs will choose 
to use it. Intuitively, when TP / increases pi, the utility of each AP in Mi does not increase. It is possible 
that some of them move to other TPs which now provide higher utility tha TP /. However, no APs that 
originally chose other TPs will move to TP /. 

Definition 1 (Convexity): The pricing of M. is convex if for any TPs I, J, K & M. with qj < qx < qj, 

Pk < VPi + (1 - v)PJi 

where rj = (qj - q K )/(q.j ~ <?/)• 



The above definition is a discrete version of a continuous convex pricing function. Convex pricing often 
reflects the underlying convex cost structure where the marginal cost monotonically increases with the 
level of quality. 

Definition 2 ( Quasi-Concavity): The utility function Ui is quasi-concave if the upper contour sets {(pi, qi) G 
: Ui(pi, qi) > u] are convex for all mgR. 

The quasi-concavity of the utility function implies that if two choices (pi,qi) and {p2,qi) provide at 
least u amount of utility for AP i, then any linear combination of the choices will induce at least that 
amount of utility for AP i. In practice, an AP often prefers better quality services until a certain level 
at which the price becomes a concern. Combined with a convex pricing, a quasi-concave utility function 
implies this kind of single-peak preference of the AP as follows. 

Lemma 2 (Single-Peak Preference): When the pricing of M. is convex and Ui is quasi-concave, for any 
TPs I,JeM with Ui{pi, qi) > Ui(pj, qj), then u^pj, qj) > Ui(p K , qx) if qi < qj < qK or qi > qj > q K - 

Proof: We first consider the case qj < qj < qx- By Definition [T] we know that pj < i]pi + (1 — rfjpx, 
where 77 = (q K - qj)/(q K - qi). By Assumption jT) we have Ui(pj,qj) > Ui{r}pi + (1 - r})p K ,qj) = 
Ui (VPi + ( 1 - v)Pk , mi + (1 - V) Ik) ■ By Definition ffl we have u { (p,j ,qj)>Ui {r}pi + (l-T])p K ,rjq I + ( 1 - 
v)Qk) > min(iti(pj, qi),Ui(p K , q K )). Since m(pi, qi) > u^pj, qj), we must have u^pj, qj) > Ui(p K , q K ). 
The derivation of the case qi > qj > qx is similar. I 
Lemma [2] gives a condition under which if an AP prefers a higher (lower) quality TP I over a lower 
(higher) quality TP J, then it prefers / over any TP whose quality is inferior (superior) to that of J. This 



condition will help us to understand the collective choice of APs of different types in Section II-C 

B. Throughput and Types of the APs 

Although the utility function can be used to model all the characteristics of AP i, the setting does 
not yet capture the traffic dynamics and the profitability of the APs. We model AP i's profitability by 
denoting u f as its per unit traffic revenue. This revenue is related to the AP's core business, e.g., online 
adverting or e-commerce, and we do not assume how it is generated. We denote Aj(-) as AP i's throughput 
function, where Aj(gj) defines the aggregate throughput of AP i toward its consumers under a quality level 
qi. Thus, we model any AP i's utility as its total profit (profit margin multiplied by the total throughput 
rate), defined by 

Ui{pi, qi) = Oi - Pi)K(qi)- (1) 

Assumption 3: For any AP i e J\f, Aj(-) is a non-increasing function with a« = lim^.^o K(qi) and 
limg^oo Ai(ft) = 0. 

Assumption [3] says that the throughput will not decrease if an AP uses a better service. Aj reaches 
a maximum value of when it receives the best quality = and decreases to zero if the quality 



deteriorates infinitely, i.e., q { tends to +00. In particular, we consider the following canonical form of the 
throughput function: 

Xi( qi ) = ai e-^, (2) 

where AP z's throughput is characterized by a parameter fa that captures its sensitivity to the received 
quality qi . 
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Fig. 1. Throughput of different type of APs. 

Figure [T] illustrates the throughput of two APs with parameters (cti, fa) = (10,1.0) and (a 2 , fa) = 
(6,0.1) under varying service qualities, interpreted as network delays in this case, along the x-axis. AP 
1 represents a Netflix-type of application that is more sensitive to delay and has a high maximum rate 
cti = 10 Mbps; however, AP 2 represents a Google-type of query application that is less sensitive to delay. 
We observe that when delay increases, the throughput of delay-sensitive application decreases sharply, 
while the delay-insensitive application decreases only mildly. 

Because is just a linear scaling factor of the throughput, it does not affect the AP's preference over 
different TPs. Consequently, APs with the same (fa, Vi) value pairs will choose the same TP; and therefore, 
we can conceptually aggregate them as a single AP. Similar to a TP I representing a market segment, each 
AP i can be interpreted as a group of APs with the same characteristics and a* represents the aggregate 
maximum traffic intensity, which depends on the number of APs in the group and the individual traffic 
intensities. Although ctj does not play a role in the AP's decision of choosing TPs, we will see later that 
a, reflects the demand of the APs and affects the market prices of the TPs. In summary, based on our 
throughput model, we define 

Ui(pi, qi) = [vi - Pi)K(qi) = Oii(vi - p/)e" ft<?1 . (3) 
Similar to each TP Fs type (pj, qj, Uj), we can characterize any AP z's type as another triple (aii,fa,Vi). 

C. APs ' Choice of Transport Providers 

When facing a set M. of TPs, each AP z's best choice J, depends on the price-quality pairs {(pi, qi) : 
I E M} and its own characteristics (fa,Vi). 

Given any AP i with (fa,Vj) and a real value u, we define the set {(pi,qi) : Ui(pi,qi) = u] as the 
indifference set of TPs that provide u amount of utility for AP i. We denote U as the normalized utility 
defined by U = ujcti and plot the indifference sets of AP % with (vi, fa) = (1.0,0.5) in Figure [2j We 
vary pi and gj on the y-axis and the x-axis. Each point (pi, qj) on the plane represents a type of TP. We 





Fig. 2. Indifference sets of AP i, (Vi,j3i) = (1.0,0.5). 



observe that in order to achieve higher utility, the AP needs a point (pi,qi) closer to the origin, which 
means either the service quality is better, or the charge is cheaper, or both. 




Fig. 3. Indifference set for U = 0.1 of different APs. 

In Figure [3j we fixed the normalized utility U = 0.1 and show the indifference set of different types 
of APs. We observe that when fa increases, which implies that throughput rate becomes more sensitive 
to quality, the indifference set shifts from right to left, showing that the APs require a better service 
quality to keep its utility. Similarly, when v { decreases, which implies that the profitability weakens, the 
indifference set shifts from top to bottom, showing that the APs require a lower pricing by TPs in order 
to keep its utility. 

Theorem 1: For a fixed set Ai and any two APs i and j with (3j > fa and Vj > v%, their chosen service 
qualities satisfy q L . > qj.. 

Proof: We prove by contradiction. Assume qi i < q^, by Assumption [Tl and 15} we know that p Ii > p Iy 



By Assumption |2} we further know that 

{vi -Pu)e~ Piqh > (vi-pije-** 1 *; 
{ Vj -p Zj )e- Piqi i > fa -piJe-P&i. 
From the above two inequalities, we can derive 

Uj - P/ t ~ «j - Pi, 

However, because pj. > p lp we have < and because gj. < gj. and /3j > we have 

e -(ft-^)?/ 4 < Q-w-PjWj m gy combining both inequalities, we derive the contradiction that 

u< - Pa e -(ft- ft -) gJ , < v i ~ Ph c -(ft-ft)^ 

I 

Theorem [T] says that if an AP j is more profitable and more sensitive to service quality than another AP 
i, then the chosen quality of AP j will be at least as good as that of AP i. This property holds regardless 
how the services are priced. 

Theorem 2: For any k±, k 2 , k 3 > 0, and system (M,Af), we define a scaled system (M',Af') as M' = 
{(Kipi+K2,qi/K 3 ,ui) : I G M} andA/"' = {(oij, K 3 /3i, KiVi+K 2 ) : i G A/"}, then system (M',Af') satisfies 
Ni(M',N') = Ni{M,N) for all I G M 

Proof: By definition, «i(pj, gj) = cti(vi — pi)e~^ iqi . Thus, under the scaled system, we have 

Ui{p'i,q'i) = a-O'-P/K^ = a i (K 1 ^ + K 2 -(/t 1 p / + fi; 2 ))e- K3ft,?//K3 = a^ 1 (^-p / )e- ft<?/ = Ki«;(pj,gi). 

Since all the utilities of the APs are scaled by K\ in the system (A4',J\f'), their choices of TPs do not 
change, and as a result, the market share A/}(A / 1 / , A/ 7 ) of the TPs do not change too. I 
Theorem [2] says that if 1) the AP profitability t>j and the TP price pj are linearly scaled in the same 
way, and/or 2) the quality qj of the TPs and the sensitivity of the APs scale inversely at the same rate, 
then the APs' choices of TP will not change. This result will help us normalize different systems and 
make a fair comparison of various solutions. 

Theorem 3: For any k > and a fixed set J\f of APs, let M' = {(pi, Kq I} vi) : I G M}, then for all 

i G N, 1) g^ < nq Li if k > 1 and 2) gj; > Kq I% if k < 1. 

Proof: We show part 1) by contradiction, and part 2) can be shown by the same arguments. Assume for 
some k > 1, I[ — J with qj > q Iv By assumption [2j we have 

{vi - p u )e-^ > { Vi -pj)e-^ qj ; 

(v t - Ph )e-^ < ( Vi - Pj ) e -^. 

However, the above inequality can be rewritten as 

(Vi-pjje-^ie-^" -1 ^ < (vi -pj)e-^ qj e-^ {K - 1)gj . 

Because qj > q Zi and k > 1, we have e _/3 ^ K_1 - ) ' ?7 * > e"^ 1 ^ -1 ^- 7 . Combined with the condition (v{ — 
P/.)e _/3i91 * > (fj — pj)e~ /3l9j , we have a contradictory condition 

( Vl -p u ) e -^ > { Vi -pj)e-^. 
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Fig. 4. Shift of market share for four TPs under (91,52,93,54) = (1,3,5,7) and (j>\,pz,p4,) = (0.7,0.25,0.1) 




Fig. 5. Shift of market share for four TPs under (91,52,93,94) = k(1,3, 5, 7) and (pi, P2,Ps,Pa) = (0.7,0.4,0.25,0.1). 



Theorem [3] says that if all the qualities in the market deteriorate (k > 1) linearly at the same rate, APs 
will not use worse quality TPs than before. The opposite is also true: when qualities improve linearly, 
APs will not use better quality TPs than before. 

With this framework, we can understand the choices made by APs when there are multiple TPs. To 
illustrate, we consider the collective choices of the APs under a market of four TPs. In Figure |4} We fix 
the qualities to be ((71,(72,93,94) = (1,3,5,7) and the prices to be (^1,^3,^4) = (0.7,0.25,0.1) and vary 
p 2 from 0.3 to 0.6 in the four subfigures from left to right. In each subfigure, we vary /3j on the x-axis 
and Vi on the y-axis. Each point (/3j, Uj) on the plane represents a type of AP. The APs located on the top 
are more profitable and the APs located on the right are more sensitive to the quality of service. Notice 
from Figure [T] that a Netflix-type AP i, i.e., (3{ = 1, would obtain around 40% and 5% of its maximum 
throughput under quality q\ and q 2 \ however, under q 3 and q<±, its obtainable throughput almost reaches 
zero. Thus, APs with higher value of will more likely choose higher quality TPs. The sets J\f 1 ,M 2 ,J\f 3 
and A/4 are shown in yellow, red, green and blue respectively. For example, A/i (A/4) represents the set 
of APs that eventually choose the TP that provides the highest (lowest) quality with the highest (lowest) 
price. For any I,Je M, we define A/jj = {(A, u*) : Ui(pi,qj) = Ui(pj,qj)} to be the set of APs that 
obtain equal utility from / and J. In each sub-figure, we plot A/12 and A/23 m solid lines and A/13 and 
A/24 in dashed lines. Thus, Figure [4] illustrates the shift of market shares for these four TPs when we vary 
the price p 2 of TP 2. 



We make the following observations. First, with the increase (decrease) of p 2 , Af 2 decreases (increases) 
monotonically (by Lemma [T|. Second, if we keep increasing (decreasing) p 2 to p\ (p 3 ), J\f 2 (A/3) will 
become empty (by Lemma [1]). Third, the upper-right APs always choose TPs with better qualities (by 
Theorem [TJ. Finally, when p 2 = 0.4 or 0.5, each set Mi forms a distinct band; however, when p 2 = 0.3 
and 0.6, we find A3 and J\f 2 to be isolated regions respectively. This can be explained by the nature of 
the pricing of M. and the quasiconcavity of the utility function as follows. 

Lemma 3: The utility function Ui(pi,qi) = (vi — pi)\i(qi) is quasiconcave if Aj(-) is in the form of 

Ai(gj) = one-**. 

Notice that when p 2 = 0.4, the pricing of Ai becomes convex and by Lemma [2] and |3} each AP has 
a single-peak preference among the TPs, where the bands show the preference peaks of the APs. When 
p = 0.3 or p = 0.6, the non-convexity in pricing induces non- single-peak preferences of some APs. For 
example, when p 2 = 0.3 (p 2 = 0.6), we can identify APs that prefer TP 2 and TP 4 (TP 1 and TP 3) over 
TP 3 (TP 2), where A/3 (A/2) shrinks to be an isolated region. 

Let us illustrate the shift of market share when TPs vary their capacity. In Figure [5J we fix the prices 
(PiiPiiPziPa) — (0.7,0.4,0.25,0.1) and qualities {qi,q 2 ,%,qA) = ^(1,3,5,7), and scale the capacities by 
k = 0.2, 0.5, 2 and 5 from left to right. We observe that when the qualities degrade, APs' choices move 
to better quality TPs gradually (Theorem [3]). 

In summary, we presented a framework to help us to analyze (and understand) the APs' decision on 
choosing TPs based on each TP J's quality and price (qi,pi), and the AP i's profitability and sensitivity 
to quality (t>j, In reality, the prices of the TPs fluctuate due to competition. Next, we will study what 
affect the market prices and characterize the equilibrium market prices, which also depends on the traffic 
intensity a, of the APs and the capacity vj of the TPs. 

III. Market Equilibrium 

In this section, we start with the definition of a market equilibrium, under which the prices of the TPs 
are stable and the claimed service qualities can be achieved when APs choose their best TPs. We then 
proceed to characterize the market equilibrium and calculate the equilibrium prices. 

A. The Existence of Market Equilibrium 

Although any TP / claims to provide service quality qj, it cannot keep its promise if more APs choose 
this TP than its capacity can support. We model the achieved quality Qj(Aj, vf) as a function of the actual 
throughput Xj going through / and its capacity Uj. 

Assumption 4: The achieved quality Qi(\i,Vi) for any TP I G M. is non-decreasing in A/ and non- 
increasing in vi. 

Definition 3: A set X C M of APs is feasible for TP / with quality qi, if Qi(\i(X), vf) < qj, where 
Xi(X) = Y^iex \ {Qi) defines the induced throughput of the set X of APs under quality qj. 

In a market M. of TPs, each TP would adjust its strategies to accommodate its customer APs' traffic 
demand and keep its service quality promise. For example, if the current capacity of TP / cannot support 
quality qj, it might 1) expend its capacity z/f, 2) increase price pi, or 3) reduce the quality level qj. Next, 
we define a market equilibrium where the APs' demand are feasible and the TPs' strategies are stable. 

Definition 4: Let p 1 J im be the cost (or minimum price) of TP /. Let M.' be identical to M. except for 
Pi 7^ Pi f° r some I E M and J\fj be the set of APs choosing TP / under Ai'. A system (Ai,J\f) forms 
a market equilibrium if 1) all APs' aggregate demands are feasible, i.e., 



Qi(h(Ni),vi) <qi, WleM, 



and 2) each price pi maximizes the utilization of capacity for acceptable throughput at TP /, i.e., for any 
p'j > pf m with the corresponding Af' T satisfying Qi(\i(J\f'j), vj) < qi, 

XiWr) < A/(jV». 

One way to understand the above definition of a market equilibrium is that given a set M of APs and a 
set {qj:I EAi} of service qualities for them to choose from, the price pi and capacity i/j of each market 
segment should be consistent in that 1) when the APs make their choices of TP, their expected service 
quality can be achieved and, 2) the capacities of the TPs are not under-utilized, unless the charge pi 
reaches the TP's cost pf m . If APs' quality expectations are not fulfilled, their choices of TP will change. 
Furthermore, if capacity vj is under-utilized with pi > p r J ltn , then the market segment / is not correctly 
priced. That being said, we assume that none of the market segment is controlled by a monopoly, which 
might want to under-utilize capacity and keep a higher price for profit-maximization. We will summarize 



and discuss the limitations of our model in Section V-D The interesting aspect here is that although pj, 



like all other prices, mainly depends on the supply uj and the demand Hi of the APs, all the TPs (or 
market segments) are correlated, which serve substitutions for the APs. 

In practice, the TPs might not have enough capacities to accommodate all APs. As a result, market 
prices will rise and some APs cannot afford the prices and will not use any of the TPs. However, under 
Assumption [2} each AP needs to choose a TP even it cannot afford to use any of the TPs, so a market 
equilibrium might not exist under this assumption. To fix this minor technical issue, we make the following 
assumption to allow any AP not to use any of the TPs if they all induce negative utilities. 
Assumption 5: There always exists a dummy TP D G M. with quality q D = oo and price p D = 0. 

By Assumption |3} quality q D always induces zero throughput for any AP, and therefore, the dummy 
TP guarantees a zero utility and can accommodate as many APs as possible in equilibrium. Effectively, 
the set Md models the APs that cannot afford to use any TP in the market in reality. 
Theorem 4: For any fixed set J\f of APs and any set M. of TPs with fixed values of p™ m ; g 7 and i/j for 
all / G M, there exists a set {p T : I G M} of prices that makes (Ai,ftf) a market equilibrium. 

Proof: The proof of existence of a market equilibrium is a constructive one. We can start with pj = p r p m 
for all / G M, and for each overloaded TP, we increase its price until its capacity is fully utilized. For 
each such a step, when overloaded TP Ps price is increased, APs will move to other TPs, making them 
possibly overloaded too. Thus, the prices of the TPs will be monotonically non-decreasing during the 
process, and therefore, will converge to a market equilibrium. I 
Although TPs might be able to adopt new technologies to improve or differentiate their services, the 
quality that they can provide is often physically constrained by the nature of the TP, for example, if a TP 
is a Tier 1 ISP, it cannot guarantee end-to-end delays for the customers unless the access ISP's link is not 
congested. Similarly, although TPs might execute a long-term capacity planning, the supply of capacity 
does not change in a small time scale. Compared to service quality and capacity, market prices change 
more frequently and easily. Theorem [4] says that even in a small time-scale where prices adapt to market 
conditions, prices might still converge to an equilibrium, which reflects the short-term market structure 
of the Internet ecosystem. 

B. Characteristics of a Market Equilibrium 

In theory, one might find multiple sets of prices that make (A4,Af) a market equilibrium. For example, 
from any existing equilibrium, one might find a TP / such that with only a small change in pj, no APs 
will change their choices. This new price also constitutes a market equilibrium. In practice, these price 
differences can happen by two reasons. First, even without a monopoly in a market segment, oligopolistic 
providers might implicitly collude on the price so that they keep a relatively high price simultaneously. 
When one of them starts to reduce price, the price of that segment will converge to a lower price. Second, 



the preferences of the APs are quite different so that the price change in one segment might not affect 
the demand choices of the APs. 

Definition 5: A market equilibrium (At,J\f) is competitive if there does not exist any pf m < p\ < pj 
with the corresponding Hi satisfying Qi(Xi(Af' I ),v I ) < qi. 

If the AP types are very diverse or each market segment consists of many competing providers, one 
can focus on the above definition of a competitive market equilibrium. Technically, a competitive market 
equilibrium might not exist, since the minimum price might not exist when all the feasible equilibrium 
prices form an open set. However, prices in practice have a minimum unit, e.g., one cent, and we can 
always find such a competitive market equilibrium. 

We will later show how to calculate competitive market equilibria. We would like to point out that our 
model is not limited to competitive market equilibria, i.e., if a segment / is not competitive enough, we 
can use a higher price for pj. As a result, competitive equilibrium prices might be biased downward if 
the real market structure is not perfectly competitive; nevertheless, our qualitative results do not depend 
on whether the market equilibrium is competitive or not. 

Theorem 5: Let W = {(kq;, 0i,Vi) : i G M} and M' = {{pi,qi, kvi) : / G M) for some k > 0. 
If (JA,J\f) is a market equilibrium and the quality function Qi(-, -)s are homogenous of degree 0, i.e., 
Qi(Xi, vi) = Qi(k\j, kuj), \/k > 0,1 G M, then (M',Af') is a market equilibrium too. 

Proof: Since aii is a linear scaling factor, it does not affect the choices of the APs and the market shares of 
the TPs. As a result, when c^s are scaled by k, the aggregate throughput A/S are scaled by k too. Because 
Qi(-, -)s are homogenous of degree 0, when vjs are scaled by k as the same time, the achieved quality 
values do not change in the scaled system. By the monotonicity of Qi of Assumption |4} we know that 
the equilibrium conditions of Definition [4] do not change, and therefore, (M.',M') is a market equilibrium 
too. I 

Theorem [5] says that if the quality only depends on the ratio of the incoming traffic rate and the capacity, 
then when the number of APs (and their traffic intensity) and the capacities scale at the same speed, the 
original market equilibrium prices will remain in equilibrium. If we consider the queueing delay as the 
quality metric, because of statistical multiplexing, the average queueing delay reduces when both arrival 
rate and service rate scales up at the same rate. In this case, Theorem [5] also implies that each TP I can 
accept more and more traffic for a fixed delay qi, and as a consequence, the market prices will move 
downward in a new equilibrium. 

C. Calculating Market Equilibrium Prices 

We denote p,j as the maximum throughput that TP I can accept when it can still fulfill the quality qj, 



defined as 



ill = argmax Q/(Aj, vi) < qj. (4) 



For instance, if the quality metric is the average queueing delay under M/G/l systems and TP / 
implements a FIFO scheduling policy, by the Pollaczek-Khinchine mean formula, 

Qi(Xi,vi) = — -!—E[R), 

Vj — Aj 

where E[R] is a constant that denotes the expected residual service time of jobs. If we want A/ to be 
feasible, we need 

^hr, E ^ - qi ^ ^ - Effcr = /»■ 

We define r/j = fij/ vj as the maximum acceptable throughput per unit capacity, or the conversion factor 
from raw capacity to achievable throughput. Notice that given a fixed capacity vj, the smaller delay TP 



I wants to provide, the smaller maximum amount of traffic it can accept. For the M/G/l case, rjj tends 
to when the required quality qj tends to 0, which also shows a convex cost structure for the TP. 

Based on the monotonicity of Qi (Assumption [4]), a market equilibrium can be characterized by using 
yU/S as follows. 

Definition 6: A system (A4,Af) forms a market equilibrium if for all TP /, 1) A/(A/}) < /!/, and 2) 
there does not exist p\ > p™ m with the corresponding J\fj satisfying A/(A/}) < A/(A/' / ) < /i/. 

Based on the above alternative definition of a market equilibrium, we can calculate the competitive 
equilibrium prices without evaluating Qj repeatedly as follows. 



Calculate Price Equilibrium (N, {pf in , qi,vi : I E M}) 

1. Set pj = oo for all TP I G M; 

2. Calculate fij for all TP I G M. based on qi and Qi\ 

3. while there exists p'j G [pf m -,Pi) such that A/(A/}) < A/(A/"j) < /i/ 

4. set pi = p\\ 

5. return {pi : / G M}; 



In the above algorithm, we do not restrict which TP / to choose in step 3 if multiple TPs satisfy 
the condition. However, any sequence of updates will make the price vector converge, because each 
price component pi will only be decreasing monotonically until convergence. Similarly, we can also set 
Pi = pT %n f° r ai l TPs, and the price vector will increase monotonically until convergence. 

Based on Theorem [2] and [5J we also have the following result. 
Corollary 1: Let N' = K 3 /3j, K X Vi + n 2 ) : i G M} and M' = + k 2 , qi/^, v'f) ■ I G M} for 

positive k, Ki, n 2 , k 3 with fi'j = k^i for all / G Ai. If (Ai,M) is a market equilibrium, then (M.',J\f') is 
a market equilibrium. 

Proof: By Theorem [2} we know that the choices of APs and the market shares of the TPs will not change 
in both systems. By the same arguments for proving Theorem [5j we know that when a^s are scaled by 
k and the effective capacity /i/s are scaled by k at the same time, the actual quality QiS do not change. 
As a result, the equilibrium conditions of Definition [4] do not change. I 

Although the prices of the TPs influence the APs' choices, which further affect the capacity utilization 
of the TPs, equilibrium prices are the fixed points in which both the APs' choices and the TPs' prices 
do not change. However, external factors could move the resulting equilibrium. In the next section, we 
will study these fundamental driving forces for the evolution of the Internet economic ecosystem. By 
understanding these factors, we will know why the market prices change and why certain evolutions 
happen. 

IV. Price Dynamics in Equilibrium 

In this section, we look deeper into the qualitative dynamics of the equilibrium market prices. In 
particular, we explore how the different characteristics of the APs and the TPs can affect the market 
prices in equilibrium. 

A. Evaluation Setting 

Each AP i is characterized by three parameters (a,, A, fj); each TP / is characterized by three parameters 
(pi, qj, vf). To make a fair comparison between equilibrium prices under different settings, we carefully 
normalize the system parameters as follows. We define v max = maxjvj : i G A/"}, (3 max = max{(3i : i G 
A/"}, and p min = min{p™ m : / G M.}. Based on Theorem [2} we normalize any system (Ai,J\f) by factors 
«4 = l/(iw -Pmin), «2 = Pmin/ {vmax- Pmin), and k 3 = l/(3 max . As a result, we normalize each ft or 



v i within the interval [0, 1] and the equilibrium prices will also be scaled accordingly with [0, 1]. If pj caled 
is the derived market equilibrium price in the normalized system, we can recover the real market price 

pi as 

Pi [Vmax Pmin)Pl ~T" Pmin- 

When the normalized price p| mied tends to 0, it reflects that the real market price pi goes down to the 
cost Pmin', when pj caled tends to 1, it reflects that the real market price pi goes to the maximum AP 
profitability v max . We describe the TPs' capacity in terms of the maximum acceptable rates /x/s. We 
define a = J2i^Af a ^ Z 1 = S/ex V" 1 anc * me rat ^° P = p/^- Based on Corollary [TJ any price equilibrium 
sustains when a^s and p/S scale at the same rate. Thus, we normalize the APs' aggregate maximum traffic 
intensity a to be 1. We define 07 = p//p as the capacity share of TP /, and under the normalized system, 
each TP I has pj = 07 p. 

After the above normalization, we can describe any system by the following four parameters: 

1) a set of qualities {gj : I E Ai}, 

2) the normalized aggregate capacity p, 

3) the distribution of over the domain [0, l] 2 of (fa,Vi), 

4) the capacity distribution {07 :/eM}. 

We focus on three different quality types: 1) q^, the highest quality for real-time content delivery, 2) 
qs, medium quality, mostly for web applications, and 3) qc, the best-effort quality, mostly for elastic 
traffic. As analyzed in [|25l . IP transit markets will be quite efficient if two tiers of services are provided; 
thus, qB and qc can be considered as the higher and lower tier services of such an IP transit market. To 
differentiate the three qualities, we set g^ : qs ■ qc — 1 : 5 : 25. We vary p from to 1, where the system's 
total capacity varies from extremely scarce to abundant. We discretize the AP domain with 50 levels of t?j 
and Pi, which forms 2500 types of APs. We assume that APs' profitability and quality- sensitivity follow 
probability distributions F v and Fp respectively, and ctj follows the joint distribution of F v and Fp. We 
use the various distributions in Figure [6] for F v and Fp. For instance, when a geometric distribution Geo 

Geo Uni ReGeo 

0.5 10 0.5 10 0.5 1 

XXX 

BN(0.2) BN(0.5) BN(0.8) 

0.5 10 0.5 10 0.5 1 

XXX 

Fig. 6. Common distributions: geometric, uniform, reversed geometric, binomial with p = 0.2,0.5 and 0.8. 



is used to describe Fp, it models the scenario where most of the AP traffic are elastic and the amount 
of quality- sensitive traffic decreases exponentially with its sensitivity level fa. The binomial distributions 



BN(p) are often used to approximate a normal distribution of the profitability i> i5 or quality sensitivity 
Pi, where p determines the mean value. 

B. Impact of TP Capacity on Prices 

In this subsection, we study how the capacities of the TPs affect the equilibrium prices. We initially 
set (qA, q_Bi Qc) — (0-2, 1, 5). We will evaluate how the quality may impact the equilibrium prices in the 
next subsection. 



(F p> F v ) = ( Uni > Un ') 



(F p ,F v ) = (Geo, Uni) (F p ,F y ) = (Geo, BN(0.5)) 
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Fig. 7. Shift in market prices as (j,b varies: with (qA, qB,qc) = (0.2, 1, 5), fiA = 0.05 and p,c = 0.25. 




Fig. 8. Shift in market prices as p varies: with (qA,qa, qc) = (0.2, 1, 5) and (Fp, F v ) = (Geo, Uni). 



In Figure[7J we fix pa = 0.05, pc = 0.25 and vary p& from to 1 along the x-axis. The three sub-figures 
show the equilibrium prices when on follows the joint distributions of (Fp, F v ) = (Uni, Uni), (Geo, Uni) 
and (Geo, BN (0.5)) respectively. We observe that when p B is scarce, equilibrium price p B is close to 
(but strictly less than) the price pa of its upper class TP. When a B increases, p B diverges from pa and 
moves to the price pc of its lower class TP. When p B becomes abundant, its market price goes down to 
the minimum price after pc- In general, when the capacity of a particular TP, i.e., p B , increases, it drives 
all equilibrium prices down; however, the prices of higher quality TPs, e.g., pa, might not go down to 
the minimum price. 



In the rest of this section, we often use Fp = Geo, which models the case where more APs were elastic, 
and F v = BN(0.5), which approximates that the AP profitability follows a normal distribution centered 
at Vi = 0.5. Note that our qualitative results do not depend on these settings. 

In Figure [8j we vary the system capacity p from to 1 along the x-axis. a, follows the joint distri- 
bution (Fp,F v ) = (Geo, BN (0.5)). The sub-figures show the equilibrium prices when the capacity ratio 
a a '■ <J B : oc equals 1 : 3 : 5, 1 : 1 : 1 and 5:3:1 respectively. In all three cases, when the total capacity 
p is small, all equilibrium prices are very close and high. When we increase p, all market prices drop. By 
comparing the price curves across the three subfigures, we observe that when the capacity share of the 
higher class TP is smaller (the left sub figure), 1) the three market prices differ more from each other, 2) 
Pc drops faster, and 3) all the prices drop to the minimum price faster than the other two cases. Because 
price differences exist in practice, we will use a a ■ o~b '■ <Jc — 1 : 3 : 5 in the rest of this section. 

Lessons (the TP capacity effects on prices) leaned: 

• Capacity expansion drives market prices down. 

• The capacity expansion of a particular TP / would affect not only its own price pi, but also other 
TPs' prices, due to the substitution effect of TP / to other TPs. 

• When TP J's capacity share 07 is small (big), its market price pj is close to the price of its next 
higher (lower) class TP. 

C. Impact of TP Quality on Prices 

Let us explore how the quality qj of the TPs may affect the equilibrium prices. We use the setting 
that the capacity distribution follows a a '■ o~b '■ o~c = 1 : 3 : 5 and aij follows the joint distribution 
(Fp,F v ) = (Geo,BN(0.5)). 

In Figure |9[ we keep the quality ratio qA : gs = q B '■ Qc — 1 : 5 and use (qA-,QB-,Qc) — k(0.2,1,5), 
where k equals 0.2, 1 and 5 in the three subfigures. We vary the system capacity p from to 1 along 
the x-axis. We observe that when all the TPs improve their quality by the same ratio, i.e., k = 0.2, the 
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Fig. 9. Shift in market prices as p varies: with (qA, qB, qc) = «(0.2, 1, 5) where k = 0.2, 1 and 5. 



market prices of the TPs are very close; when all the TPs degrade their quality by the same ratio, i.e., 
k = 5, the market prices of the TPs diverge greatly. This observation can be explained by Theorem |3j 
When k decreases and all qualities are improved, more APs will choose lower class TPs, which move the 
prices of the lower class TPs upward and the prices of upper class TPs downward. As a result, all TPs 
prices will move closer. On the other hand, when k increases and all qualities are degraded, more APs 




will choose to upper class TPs, which move the prices of the upper class TPs upward and the prices of 
lower class TPs downward. This will further diverge the price differences among the TPs with different 
qualities. 



In Figure [10} we keep qs = 1 and vary the quality ratio qA ■ qs = Qb '■ qc = 1 '■ k, where k equals 2, 5 
and 10. We observe that the price differences are positively correlated with the quality ratio. In particular, 
when quality ratio is high, e.g., k = 10, the price of the lowest class TP, i.e., pc, drops earlier and sharper 
when the total capacity p expands. At the same time, higher class TPs can still maintain a non-zero market 
price even after pc drops down the minimum price. The general trend is that when the quality ratio keeps 
increasing, the price curves will move higher and toward the left. In the rest of this section, we will often 
use the quality ratio 1 : 5 and (q&, q Bl qc) — (0-2, 1, 5) for our evaluations. Again, our qualitative results 
do not depend on this setting. 

Lessons (the TP quality effects on prices) leaned: 

• The market prices of the TPs would be close to (far from) one another if the quality ratio is small 
(big) or/and the overall qualities of the market are high (low). 

• In reality, the qualities provided by the TPs are becoming better and better, which implies that market 
prices for different services might converge. 

• High-end market segments can still maintain a price difference if they can differentiate their quality 
from the lower class TPs substantially. 

Next, we will see that the TP price differences also depend on the demand side: the characteristics of the 
APs. 

D. Impact of AP Wealth on Prices 

Let us explore how the profitability distribution F v may affect the equilibrium prices. We still keep 
a a '■ <J B ■ &c — 1 : 3 : 5 and (qA,qB,qc) = (0-2, 1,5). follows the joint distribution of Fp and F v , 
where Fp is distributed as Geo. 



In Figure 1 1 , we vary p from to 1 along the x-axis and plot the equilibrium prices where the 
profitability distribution F v follows a binomial distribution BN(p) parameterized by p = 0.2,0.5 and 0.8 
respectively. By doing this, we simulate the normal distributions of the APs' wealth varying the mean 
value from small to large. We observe that despite the difference in mean profit of the APs, pc drops to 
the minimum price at the same time. The price curves in all cases keep the same shape; however, they 





Fig. 12. Shift in market prices as p varies: (qa, Qb, qc) = (0.2,1,5), a a ■ &b '■ = 1 : 3 : 5, Fp = Geo. 



scale differently on the vertical axis. This indicates that the market prices depend on how much the APs 
are able to pay for the services, and how they demand for the TPs based on their values of ((3i,Vi). 



In Figure 12 we vary F v to be Geo, Uni and ReGeo. We observe that the shapes of the price curves 
are very different: prices decrease convexly, linearly and concavely in the three subfigures. In general, 
how fast the prices drop depends on the density of the APs whose profitability are around that price range, 
and the shape of the curves look like the complimentary cumulative distribution function (CCDF) of F v . 

Lessons (the AP wealth effects on prices) leaned: 

• The market prices of the TPs are positively correlated with the mean profitability of the APs. 

• At a certain price range where the density of the APs is high (low), more (less) competition among 
the APs drives the prices close to (far below) their profitability. 

E. Impact of AP Quality-Sensitivity on Prices 

In this subsection, we study how the quality sensitivity distribution Fp affects the equilibrium prices. 
We set a a '■ o~b '■ oc = 1 : 3 : 5 and p = 0.5. In the following cases, Fp follows a binomial distribution 



BN{p), where we vary the parameter p along the x-axis. By doing this, we simulate the cases where the 
APs become more and more sensitive to quality when the mean sensitivity increases with p. 
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Fig. 14. Shift of market prices when we vary AP's sensitivity to quality: with a a '■ <?b '■ crc = 1 : 3 : 5, p = 0.5, F v = BiV(0.5) and 
Fp = BN{p). 



In Figure 13 we fix (qA,QB,Qc) = (0.2, 1,5) and vary F v to be Uni, BN(0.B) and Geo in the three 



sub-figures. We observe that although the profitability distribution affect the absolute price values, the 
shape of the price curves look similar. When the quality sensitivity of the APs increases, the lowest 
quality service price, i.e., p c , drops sharply and quickly. Although p& and p B drops accordingly with p c , 
after pc reaches the minimum price, both pa and pb rebound. With further increase in quality sensitivity, 
Pb shows a trend to decrease slowly; however, pa always stays at a high level. When the APs become 
more sensitive to quality, more and more APs start to move to higher class TPs. As a result, the capacity 
He becomes under-utilized, which also drives pc down very quickly. Although p c 's drop pulls down the 
overall market prices, more APs move to higher class TPs, which make TPs A and B in demand, and 
therefore, keep pa and ps steadier. After pc reaches the minimum price, pc stops decreasing. As the APs' 



quality sensitivity keeps increasing, even the minimum market price of pc becomes relatively expensive 
to the APs. This makes even more APs move to TP A and B and drives pa and ps upward. 



In Figure 14 we fix F v = BN(0.5) and vary the qualities to be (<Za> <Zb> (Zc) = k(0.2, 1,5), where 
K = 0.5, 1 and 2. We observe the same trends as in Figure [13] that pc drops quickly and sharply to the 
minimum price as the APs' quality sensitivity increases. As k increases, all the price curves move to 
the left and the price drop of lower class TPs becomes quicker and sharper. This also coincides with the 
observations made in Figure [9] that when the qualities degrade, the price of the lower class TP drops much 
quicker. 

In the above illustrations, we vary the distribution Fp. It is also possible that all the APs' sensitivity 
increase by = for some £ > 1. By Theorem [2} we can rescale the system by n 3 = l/£, as if the 
APs keep their quality sensitivity constant and all the qualities become poorer. By Theorem [3] and the TP 
quality effect result in Figure [9j we also conclude that more APs will prefer higher quality TPs and the 
price of the lower quality TPs will drop sharply. 

Lessons (the AP quality-sensitivity effects on prices) leaned: 

• When the APs become more sensitive to the service quality, the price of lower class TPs will drop 
quickly. 

• When the price of the lowest quality TP goes down to its cost, the prices of higher quality TPs might 
increase due to their relatively cheap prices and high demand. 

F. Internet Evolution: Some Explanations 

By understanding the factors that drive the market equilibrium, we reason about the evolution of the 
Internet ecosystem and reach plausible answers to the questions raised in Section [TJ We do not claim that 
our answers below are exhaustive and the limitations of our model will be discussed in Section IV-Dl 

1) Why have the IP transit prices been dropping? The capacity effect tells that the price drop can be 
a consequence of the capacity expansion of the transit providers. Compared to the capacities at the last- 
miles, the capacity in the backbone grows faster than demand and is abundant ||T4]|. Also, the price drop 
in better quality services, i.e., CDN prices, will drive the transit prices further down. The quality effect 
tells that when the transit quality differs a lot from the CDN services, the prices will diverge greatly. 
The wealth effect tells that since the majority of the elastic APs might not be very profitable, transit 
providers cannot fully utilize its capacity and charge a high price at the same time. This is also why they 
are looking for providing value-added and differentiated services. Last, the AP quality- sensitivity effect 
tells that when AP traffic becomes more and more inelastic, e.g., the surge of Netflix traffic, lower quality 
service will become less valuable and therefore its price will drop quickly. 

2) Why have the CDNs emerged in the ecosystem? The capacity effect tells that when the capacity 
of higher quality service is small, it can maintain a price difference with the lower quality services. The 
quality effect tells that if a CDN service's quality differs a lot from the transit services, it can be priced 
much higher. When the capacity of the transit market was limited and priced high, the demand for even 
higher quality service drove the price for potential CDN services even higher. This explains why CDNs 
emerged in the first place. The wealth effect tells that when the APs' profitability is not high, the market 
prices cannot be high. However, due to the low cost structure of the CDNs, they can still help small APs 
who could not afford the infrastructure to support large demand. The AP quality- sensitivity effect further 
tells that with the traffic being more and more sensitive to quality, the price of high quality CDN can 
sustain at a high level. 

3) Why has the pricing power shifted to the access ISPs? This can be partially explained by the AP 
quality-sensitivity effect and the TP quality effect. When the AP traffic becomes more and more sensitive 
to service quality, they are more willing to pay for the higher quality services. Because access ISPs are 
physically closer to the users, their service quality is naturally much better than other providers who have 



to go through the access ISPs to reach the end-users anyways. Consequently, the difference in service 
quality makes it possible for the access ISPs to charge services at higher prices. Furthermore, Comcast's 
monopolistic position in the U.S. market could be another reason, under which its price will be set higher 
than the competitive market price under Definition |5j 

4) Why are the large content providers building their own wide-area networks toward users? Mostly 
because the APs become more sensitive to service quality, they cannot rely on the transit providers to 
deliver content. As high quality services are limited and access ISPs would obtain more pricing power, 
large APs might consider establishing their own networks toward users as a cheaper alternative than paying 
access ISPs for better services in the future. 

V. Internet's Economic Evolution 

Besides understanding how each isolated factor might affect the market prices, we incorporate ground 
truth data IfTOl . [fP9ll , flU, [fTTTl . e.g., the historical trends of the TPs' capacity expansion and the APs' 
characteristics, and project possible future price dynamics of the Internet ecosystem. Through this, our 
model can help the TPs make various long-term business decisions. Let us demonstrate this. 

We take a macroscopic view and categorize network services as two types: M. = {A, B}. B models 
the IP transit service that provides interconnection based on "best-effort"; while A models the CDN or 
private peering type of service that provides better service quality than B. We categorize the APs as three 
types: J\f = {a,b,c}. a models the video or realtime interactive applications that are very sensitive to 
quality, b models the web applications that are elastic but more tolerate to quality than type a applications, 
c models the inelastic applications, e.g., email and P2P file download. 

By Theorem [2] and Corollary [T| we know that when quality and the sensitivity parameters scale inversely, 
the equilibrium remains the same; therefore, without loss of generality, we set qs = 1 as the baseline 
best-effort quality level. We set the quality sensitivity parameters to be (/3 a , (3b, (3 C ) = (10, 1,0.1). Under 
this setting, type a APs would only obtain e -10 ps 4.5~ 5 of their maximum throughput under qs, which 
implies that the best-effort service cannot support quality sensitive applications. Also, under q B , a type b 
AP could get e _1 w 37% of its maximum throughput; however, a type c AP could get e~ ai ~ 90% of 
its maximum throughput. When measured by delay, the quality of service (QoS) for realtime applications 
often require the delay to be at the order of milliseconds lETTl . compared to the best-effort service delays 
at the order of seconds. Thus, we choose qA = 0.01 to reflect the same order of magnitude of service 
difference. As a result, even type a APs would obtain e~° 1 ~ 90% of their maximum throughput under 
the better quality level qA- 

Next, we try to estimate the capacity of the TPs on the Internet. We take the Equinix Internet Exchange 
at New York (Equinix-NY) as a reference market and estimate the capacities based on the data provided 
by PeeringDB IfTOl . At the end of year 2011, there were 102 ISPs listed on at Equinix New York Exchange 
in PeeringDB, among which 44 use Open peering policy and the remaining 58 use either Selective or 
Restricted peering policy. The total capacity was around 21 Tbps, among which the ISPs using Open 
peering policy contributed 7 Tbps and the remaining ISPs contributed 14 Tbps. Since Selective and 
Restricted policies are used for private and often paid-peering agreements, we set va and vb to be 14 and 
7 Tbps, for the reference time of the year 2011. 

From the Global Internet Geography [4] report, between 2007 to 2011, the international Internet capacity 
increased six-fold and the bandwidth to the U.S. had increased nearly 50 percent per year. To a first 
approximation, we assume that the capacity v of the TPs increases 50% per year. We define a = a a +ab+a c 
and oj a , and u c as the weight of the throughput upper bound of each application type. Given a and 
the weight of AP i, we obtain as 

an = a, V i = a, o, a 

U a + U b + UJ C 



Based on the observed traffic distribution of various applications in |fT9ll , we set (ui a , ui b , u c ) = (2%, 75%, 23%) 
for the year 2007, and assume that the weight for video (co a ), web (cob) and inelastic applications (ui c ) 
increase at an annual growth rate of 150%, 50% and 20% respectively. Notice that IP transit prices are 
often quoted for per Mbps-month, while CDN prices are often quoted for per terabit. If capacity is fully 
utilized 24/7, $1 per Mbps-month can be translated into $0,386 per terabit. We assume that the maximum 
per unit traffic revenue for the APs is $10 Mbps-month and the APs' revenue are uniformly distributed. 

A. A First Approximation Benchmark 

We use our macroscopic model to fit the historical prices starting from 2007 and project future Internet 
prices. In a first approximation, we choose the following parameters. 

1) a at year 2007 (denoted as a 07 ) equals 10 Tbps. 

2) a increases at an annual growth rate r a = 22%. 

3) 1] A = ha/va = 0.3 and rj B = Hb/vb = 0.9. 
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Fig. 15. Historical price and future price projection. 
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In Figure 15, the upper left sub figure plots the achievable throughput for the CDN (ha) and IP transit 
services from 2007 to 2014 and the lower left subfigure plots the maximum demand a a , ctb and 
a c for the same time period. The upper right subfigure plots the price dynamics of both IP transit and 
CDN services and the lower right subfigure plots the percentage of price change for both services. We 
observe that average price drop from 2007 to 2011 is approximately 20%, which coincides with the price 
drop surveyed in the Global Internet Geography [4J report. Also, the price of IP transit is below $2 per 
Mbps-month, very close to the mean of IP transit prices, where the lowest price fell to $1 per Mbps-month. 



Compared to the video delivery pricing [fTTTl . our price projection shows that the CDN price drops 
around 8% annually from 2007 to 2011, and reaches $5.67 per Mbps-month, or $2.18 per terabit. This 
price is lower than the $7.5 per terabit price for APs with volume of 5PB data and the price drop is slower 
than the observed 20% price drop in the CDN industry [11 J. The difference could come for two reasons: 
1) since CDN service charges based on traffic volume, we cannot assume that the APs would always use 
the capacity 24/7, and therefore, the CDN providers should charge some premium on top of the basic 
per Mbps per month charge, 2) in contrast to our competitive model for CDN service, the industry might 
be less competitive and could charge a much higher price; therefore, when the industry becomes more 
competitive, we expect to see much sharper price drops. 

Based on the trend from 2007 to 2011, our model projects that both the IP transit and CDN prices will 
further drop, at an even faster rate, and IP transit price will drop to its minimum price. Of course, this 
projection is based on the assumption that the capacity of the TPs will keep expanding at the 50% annual 
rate. We will further discuss potential trends of future prices in a later subsection. 

B. Sensitivity of the Benchmark 

In this subsection, we show the sensitivity of our price projection with respect to the chosen parameters. 
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Fig. 16. Sensitivity to initial demand am and rate r a . 



First, we want to see how the demand parameter a affects the price dynamics. Figure 16 shows a 
projection of service prices when the initial value a 07 and the growth rate r a change. In the left subfigure, 
we vary a 07 to be 9 and 11 Tbps compared to the benchmark value of 10 Tbps. We observe that the 
prices are positively correlated with a 7- In the right subfigure, we vary the growth rate r a to be 20% and 
24% compared to the benchmark value of 22%. We observe that the prices again are positively correlated 
with r a . Both tells that when the demand increases, so do the prices. 

Second, we want to see how the capacity utilization factor rjj = fii/uj affects the price dynamics. 



Figure 17 shows a projection of Internet service prices when tja and t]b vary from the benchmark. In the 
left subfigure, we vary t\a to be 0.2 and 0.4 compared to the benchmark value 0.3. In the right subfigure, 
we vary r\B to be 0.8 and 1.0 compared to the benchmark value 0.9. We observe that the all prices are 
negatively correlated with the capacity utilization factors. Also, the IP transit prices are sensitive to both 
t)a and t]b\ while the CDN prices are only sensitive to its utilization factor t]a- 
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C. Price Projection and TP Business Decisions 

Now, we demonstrate that by using the price projection from our model, we can help the TPs to make 
business decisions on 1) how aggressive the TPs should expend their capacity, and 2) whether the TPs 
should/would tend towards Open or Selective peering policies. 



■^P A (v A :v B ^3:1) 
*-Pa(V v b- 3:2 > 




2008 2010 2012 2014 



2008 2010 



2012 2014 



Fig. 18. Price projection under various capacity ratios va '■ vb and capacity expansion rate r v . 



To answer the first question, we vary the capacity growth rate of the TPs r v to be 40% and 60%, 
compared to the historical benchmark rate 50% and plot the price projections in the left subfigure of 



Figure 18 We observe that when the capacity grows at 60% per year, both the CDN and IP transit price 
drop fast and the IP transit price will down to its cost next year; however, when the growth rate is 40%, the 
IP transit price will be decreasing at a very slow rate. These observations tell us that the ISPs providing IP 
transit services might want to slow down their investment in capacity expansion; however, CDN providers 



and ISPs that sell private-peering and QoS might want to continue to expand their capacity when their 
profit margins are still above zero. As the price of IP transit drops, we believe that the investment in the 
transit capacity will slow down, which will also stabilize the price of the IP transit services. 

To answer the second question, we vary the capacity ratio va '■ vb from the benchmark ratio 2 : 1 (14 
Tpbs : 7 Tbps) to 3 : 1 and 3 : 2 for the year 2014 in the right sub figure. These two projections model the 
scenarios where ISPs will tend to be more Selective and more Open in their peering policies respectively. 
We observe that if more ISPs are going to use an Open peering policy, the IP transit price will drop 
to its cost quickly; otherwise, the IP transit price will get closer to the CDN price and be stable. This 
observation implies that ISPs would have strong incentives to move towards Selective peering policies 
if possible, which coincides with the reality that the access ISP, Comcast, started to use private peering 
exclusively. 

In summary, we predict that although the CDN price will still be dropping in the coming years, the 
price of IP transit will be more stable. Furthermore, the capacity expansion will slow down and more 
ISPs will tend to use Selective rather than Open peering policies in the near future. 

D. Limitations of the Model 

Although we have demonstrated potential usages of our model, we want to mention the limitations of 
the model so as to avoid misinterpreting the results obtained from our macroscopic model. 

First of all, our general equilibrium model implicitly assumes that each market segment is competitive. 
In practice, some market segment could be lack of competition and form a monopolistic or oligopolistic 
market structure. Thus, the real market prices will be higher than what our model predicts. Second, 
our equilibrium model does not capture the off-equilibrium and transit dynamics that could happen in 
practice. Third, our model is in nature macroscopic, and it does not capture detailed information like 
peering agreement, topology, traffic patterns and etc. Nevertheless, our model does capture the type of 
different services the TPs provide via implicitly encoding all the relevant information into the quality level 
qj. From the APs' point of view, they do care about quality rather than other details of the TPs. Fourth, 
since our focus is on the transit/CDN market, our model does not intend to capture the end-user market 
aspects. For example, modeling the bundle of access services and other service differentiations are out of 
scope. Last but not the least, our macroscopic model provides some qualitative reasons for the Internet 
evolution, which we do not claim to be exhaustive. There might be additional factors/reasons that are not 
captured by our model, e.g., the lack of competition in the market. 

VI. Related Work 

Many empirical studies have been tracking the evolution of the Internet using measurements and public 
data sets JT5|, Q3), El, OH. OH- Labovitz et al. [19] measured the inter-domain traffic between 2007 
and 2009, and observed the changes in traffic patterns as well as the consolidation and disintermediation 
of the Internet core. Gill et al. [TTTll collected and analyzed traceroute measurements and showed that 
large content providers are deploying their own wide-area networks. Dhamdhere et al. [[T5l confirmed the 
consolidation of the core of the Internet, that brings the content closer to users. Akella et al. |fT2l| used 
measurements to identify and characterize non-access bottleneck links in terms of their location, latency 
and available capacity. At the edge of the Internet, Sundaresan et al. [24] studied the network access 
link performance measured directly from home gateway devices. We focus on a macroscopic model of 
the Internet ecosystem that captures the application traffic going through the network transport service 
providers. 

Many works O. lH3» ED. E3, 03, ED, CHI focused on the modeling perspective of the Internet 
evolution. Chang et al. lfl~3l presents an evolutionary model for the AS topologies. Lodhi et al. EOl used 
an agent-based model to study the network formation of the Internet. Motiwala et al. 112211 used a cost 
model to study the Internet traffic. Valancius et al. combined models and data to study the pricing ll25ll 



structure of the IP transit market. Faratin et al. [16| and Ma et al. [21 J studied the evolution of the ISP 
settlements. In this work, we take a holistic view and analyze the business decisions and evolutions of 
the APs and TPs altogether. 

VII. Conclusions 

In this paper, we proposed a network aware, macroscopic model to explain the evolution of the Internet. 
This model captures 1) the business decisions of the APs, 2) the pricing and competition of the TPs, and 
3) the resulting market equilibrium of the ecosystem. By analyzing how the AP characteristics (i.e., traffic 
intensity, profitability and sensitivity to service quality), and the TP characteristics (i.e., quality, price 
and capacity, affect the market equilibrium), we obtain fundamental understanding of why historical and 
recent evolutions of the Internet have happened. With further estimations of the trends in traffic demand, 
capacity growth and quality improvements, our model can also project the future evolution of the Internet 
ecosystem. This model provides a tool for the Internet players to better understand their business and 
risks, and help them to deal with their business decisions in the complicated and evolving ecosystem. 
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